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1.  Introduction 


There  is  interest  in  developing  non-line-of-sight  sensors  for  monitoring  human  activity.  While 
individuals  perfonning  activities  can  intentionally  or  unintentionally  reduce  their  signature  to 
sensors  such  as  microphones  and  cameras,  they  may  generate  other  clues  that  can  be  exploited. 
Active  acoustics  can  be  used  to  perform  change  detection  inside  buildings.  Common  challenges 
with  active  acoustics  systems  are  audible  range  frequencies  giving  away  the  position  of  the 
system  and  ultrasound  frequencies  quickly  attenuating  with  range  (1  dB/m)  (7).  In  order  to  avoid 
these  issues,  we  use  an  acoustic  source  of  opportunity  such  as  a  radio,  a  conversation,  or  another 
similar  signal.  This  mitigates  the  problem  of  the  source  being  discovered  and  reduces  the  cost  of 
the  system  (2,  3). 

Change  detection  is  the  process  of  using  data  from  sensors  to  measure  a  change  in  the 
surrounding  area  at  different  times.  Change  detection  is  accomplished  by  subtracting  a  reference 
image  or  profile  of  an  area  from  a  test  image  ( 4 ).  Any  changes  in  the  scene  are  noticed,  while 
things  that  stayed  the  same  are  cancelled.  An  acoustic  change  detection  algorithm  requires  an 
image  or  profile  of  the  environment.  A  relatively  simple  way  of  generating  an  acoustic  profile  of 
an  area  is  to  cross-correlate  the  data  measured  on  two  microphones  (5).  For  discrete  signals, 
cross-correlation  is  defined  as 


Rxy("0  =  X  x(n)y(m  +  n),  (1) 

m=- oo 

where  x(n)  is  the  measured  signal  from  microphone  1  at  index  n  and y(m+n)  is  the  measured 
signal  from  microphone  2  at  time  (m+n).  With  the  addition  of  a  third  microphone,  acoustic 
imagery  could  be  generated  and  allow  for  localization  in  a  plane. 


2.  Experiment 


The  algorithm  was  tested  with  a  simple  experiment.  Two  microphones  were  placed  4  m  apart. 
The  acoustic  source  was  an  FM  radio  that  was  placed  less  than  aim  away  from  the  first 
microphone.  The  radio  was  set  to  a  station  that  played  music  and  talk.  Data  from  the 
microphones  were  recorded  at  a  sampling  rate  of  10  KHz  with  the  door  position  either  opened  or 
closed  (figure  1).  The  data  collected  during  different  trials  were  used  to  evaluate  the  algorithm. 
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3.  Algorithm 


The  algorithm  begins  by  filtering  low  frequency  noise  using  a  Butterworth  filter.  Next,  the  data 
sets  from  microphones  1  and  2  are  split  and  delayed  by  approximately  40  s.  This  ensures  that  the 
data  are  only  from  periods  where  the  door  was  completely  open  or  completely  closed. 

The  channels  are  equalized  by  first  converting  the  data  into  the  frequency  domain  (figure  2) 
using  a  fast  Fourier  transfonn  (FFT).  The  amplitude  of  the  two  spectrums  are  equalized  to 

5'(w)  =  min(|X1(®)|,|X2(®)|),  (2) 


where  Xi(co)  and  Xiio))  are  the  discrete  Fourier  transfonns  of  the  data  on  microphones  1  and  2,  co 
is  frequency,  and  min  is  minimum  of  the  amplitude  of  the  two  spectrums  for  each  frequency.  To 
equalize  the  spectrums,  the  original  spectrums  are  divided  by  their  own  magnitudes  and  then 
multiplied  by  the  magnitude  of  the  S(w).  Then,  the  signals  are  converted  back  to  the  time 
domain  using  an  inverse  fast  Fourier  transfonn  (iFFT).  These  new  time  domain  signals  are  now 
equalized.  Next  the  data  are  cross-correlated.  The  outputs  of  the  cross-correlations  are 
subtracted  and  normalized  using 


D(n)  = 


r(n) \r(n)-r0\ 

a) 

0 

2 

+  1 


(3) 


where  Rxiyi(n)  is  the  first  cross-correlation  at  index  n  and  RX2y2  (n)  is  the  second  cross-correlation 
at  index  n,  and  r(n)  corresponds  approximately  to  the  range  and  is  given  by 

r(n)  =  cnT  +  rx,  (4) 


where  n  is  the  index,  c  is  the  speed  of  sound,  T  is  one  over  the  sampling  rate,  and  h  is  the 
distance  between  the  source  and  the  first  microphone.  This  normalization  partially  accounts  for 
the  attenuation  of  the  signal  with  range.  Next,  the  sum  is  compared  to  a  threshold  based  upon  a 
Student’s  /-distribution. 
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Figure  2.  A  portion  of  the  frequency  domain  data  (red  and  green)  with 
the  desired  spectrum  (blue). 

Figure  3  shows  a  block  diagram  of  the  algorithm. 


Figure  3.  A  block  diagram  of  the  algorithm. 
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4.  Processing 


Results  are  shown  for  data  collected  during  two  different  trials.  First,  the  data  are  equalized  using 
equation  2.  Figure  4  shows  the  waveforms  in  time  when  the  door  was  opened  and  figure  5 
shows  the  waveforms  in  a  time  when  the  door  remained  closed. 

4000  - 1 - 1 - 1 - 1 - \ - - — — — — . 


3000 

2000 

1000 

0 

-1000 

-2000 

-3000 


-4000 


_ L 

0  2 


_i _ i _ 

10  12  14 


xIO5 


Figure  4.  Acoustic  data  from  a  trial  during  which  the  door  was  opened. 


Figure  5.  Acoustic  data  from  a  trial  during  which  the  door  remained  closed, 
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Next,  the  results  from  figures  4  and  5  are  cross-correlated.  The  results  are  shown  in  figures  6-9. 
Figures  8-9  are  zoomed-in  versions  of  the  data  in  figures  6-7.  The  x-axis  has  been  converted  to 
range  by  multiplying  the  time  variable  in  the  cross  correlation  by  the  speed  of  sound.  The  large 
peak  in  the  figures  occurs  at  4.5  m,  which  correspond  to  the  distance  between  the  microphones. 


Figure  6.  The  cross-correlations  of  data  from  a  trial  during  which  the  door  was  opened. 


Figure  7.  Cross-correlations  of  data  from  a  trial  during  which  the  door  remained  closed. 
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Figure  8.  The  cross-correlations  from  the  trial  where  the  door  was  open  at  time  1  and  closed  at  time  2. 


x  104 


Figure  9.  The  cross-correlation  from  a  trial  where  the  door  remained  shut  at  time  1  and  time  2. 
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Lastly,  the  cross-correlations  are  subtracted  from  each  other,  normalized,  and  then  summed. 
Figure  10  shows  the  results  for  the  door  being  opened  then  closed,  while  figure  1 1  shows  the 
results  for  the  door  being  shut  at  both  times. 


first  two  events,  file=AD7IQ016  det=218.7238 


Figure  10.  The  difference  of  the  cross-correlations  from  a  trial  where  the  door  was 
opened  has  a  sum  of  218. 


first  two  events,  fi I e= AD7 1 Q0 1 9  det=44.41 01 


Figure  11.  The  difference  of  the  cross-correlations  from  a  trial  during  in  which  the 
door  remained  closed  has  a  sum  of  44. 
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5.  Discussion 


The  results  show  that  the  sum  of  the  differences  in  the  amplitude  of  the  cross-correlated  signal 
received  when  the  door  position  changed  is  greater  than  with  no  change.  This  is  the  result  of  the 
change  in  the  scattering  of  the  acoustic  energy  caused  by  the  door  opening.  Statistics  were 
calculated  on  the  average  normalized  differences  between  the  cross-correlation  results  with  no 
change  in  the  environment  using  the  four  data  sets.  The  mean  was  28  and  the  standard  deviation 
was  38.  The  sum  of  the  data  when  the  environment  was  changed  was  218.  This  is  greater  than 
four  standard  deviations  away  from  the  mean  results  when  the  environment  remained  constant. 
These  results  were  evaluated  using  a  Student’s  /-test,  which  indicated  that  there  was  greater  than 
a  99.9%  confidence  that  a  change  occurred. 


6.  Conclusion 


These  results  demonstrate  acoustic  change  detection  using  sources  of  opportunity.  The  simplicity 
of  this  technique  means  that  acoustic  surveillance  could  be  conducted  using  inexpensive  and 
nearly  unnoticeable  equipment. 

Ideally,  the  range  to  the  change  could  be  determined,  but  this  algorithm  was  unable  to  detennine 
the  range  because  of  the  noisy  cross-correlation  results  and  a  complex  scattering  environment.  A 
more  complex  algorithm  is  required  to  obtain  reliable  range  information. 
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